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A JOUCH PAD. A STYLUS FOR U^EiAaiH^WE^TOOCR PAD. AND A METHOD OF 
OPERATING THE TOUCH PAD 



The present invention relates to an improved touch pad and in particular to a touch pad 
5 which receives the light within a light transmissive means and determines where the light 
entered the means. Touch screens of this type have the advantage that they may e.g. be 
made quite hard and more resistant to excessive pressure. Also, a number of additional 
features, such as the addition of keyboards etc may be obtained. 

10 Touch pads and other types of systems for entering information into a computer may be 
seen from US-A-4,772,763, JP-A-580 10232, JP-A-59202533, JP-A-1 1232025, 
WO02/095668, WO02/077915, US-A-4,692,809, US-A-5,945,981 , US-A-5,227,622, US- 
A-5, 166,668, and EP-A-1 209 554. 

15 In a first aspect, the invention relates to a touch pad having: 



a light transmissive means having a first surface adapted to receive light, the 
transmissive means being adapted to transmit received light inside the light 
transmissive means along the first surface, 

a first and a second means adapted to receive light received by the surface, 
transmitted along the first surface by the transmissive means, and for 
outputting corresponding signals, and 

means for determining, on the basis of signals from the receiving means, a 
position of the first surface having received light. 



Thus, instead of transmitting the light through the light transmissive means, the light is 
transmitted therein and to the light receivers. 

In the present context, a means is light transmissive, when, at at least one wavelength 
30 present in the light received, the absorption of the light is sufficiently small to have at least 
part of the light reach the receiving means. This or these wavelength(s) may be in the 
visible spectrum, the infrared spectrum, and/or the ultraviolet spectrum. Preferably, the 
means is able to transmit at least 50 % of most of the wavelengths in the visible spectrum 
over a distance from a majority of positions of the first surface and the receiving means. 

35 
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Preferred materials for the light transmissive means may be glass, polycarbonate, 
transparent polyethylenes, PET, acrylate, ABS, nylon, styrene, or similar materials. 

An interesting feature of the present invention is the fact that the light received is 
5 transmitted inside the light transmissive means and along the first surface. Thus, light 
received is now redirected and at least partly guided by the means and not merely 
transmitted straight through as would be the case in e.g. a projection screen. Naturally, 
the amount of the light actually received and redirected by the light transmissive means 
will depend on the angle under which the light enters as well as the wavelength etc. Thus, 
10 in order to obtain a suitable angle, the light is preferably provided close to the first surface 
in the form of a non-collimated beam. 

In this context, other elements, such as the flexible element mentioned further below, may 
also take part in the guiding of the redirected light. The receiving means are thus 
15 positioned so as to receive light transmitted along the first surface. These means may be 
positioned in a plane of the light transmissive means or a plane parallel with a plane of the 
first surface. 

The light received and guided inside the light transmissive means will propagate in the 
20 means depending on the shape thereof, its surfaces (reflecting properties), its absorbance 
etc. Also, depending on the intensity distribution of the light, its direction of transmission 
may be both in the direction of the first surface and a direction perpendicular to that. At 
least part of the received light will be reflected from a surface of the light transmissive 
means and thereby be guided toward the receiving means. 

25 

Preferably, the light transmissive means is at least substantially flat. In this manner, flat 
touch screens may be provided. Also, the light guiding properties and the ability to 
actually receive the light is improved in flat means. 

30 For a number of reasons, the light transmissive means is preferably planar in that that 
shape is the easiest surface to follow when writing etc. However, any shape of the 
transmissive means may be used as long as it facilitates light guidance between the 
position of entry of the light and the receiving means. In fact, bent touch pads may have 
advantages in that one, e.g. a planar, area may be used for normal "writing" and other 
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areas, such as sides of the pad, may be used for buttons or predetermined areas (see 
further below). 

A number of interesting embodiments relate to what information is actually derived from 
5 the light received. Normally, the output of the receiving means would be position 
information (such as an angle at which a maximum of light intensity was received) or a 
voltage/current relating to a light intensity received. Other information may relate to a 
variation in the light intensity (see further below) or to the wavelength or wavelength 
interval/mix of the light. 

10 

In one embodiment, the determining means may use standard triangulation in order to 
perform the determination of the position. Also, naturally, more than two receiving means 
may be used in order to e.g. increase a precision in the determination of the position or to 
increase an area within which light or positions may be identified, received or determined. 

15 

In the present context, the position at which the light is received will normally be a position 
at or on the first surface at which the light actually enters the light transmissive means and 
starts propagating within the light transmissive means. This position may be determined in 
any coordinate system and e.g. as an absolute or relative distance/angle from any other 
20 point or position of the touch pad. 

A touch screen may be obtained when combining the above touch pad with a display or 
monitor, the monitor or display being positioned so as to provide or display information 
provided or displayed thereby through the first surface of the light transmissive means. 

25 

In another embodiment, the light transmissive means comprises an at least substantially 
flat light transmissive member having at a surface thereof a light transmissive coating or 
layer, an upper surface of which forms the first surface of the light transmissive means. 
This coating or layer may be used for protecting the means from scratches or may provide 
30 a mirroring or non-reflecting surface. A coating may be hard, such as hard silicone, or a 
hydrophilic surface. 

An interesting type of member is one comprising a light transmissive display or monitor, 
whereby the touch pad is, again, a touch screen, now with the "pad" positioned below the 
35 monitor/display. 
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In another embodiment, the touch pad further comprises a flexible element positioned at 
or on the first surface and a light emitter adapted to transmit light into the flexible element, 
the element being adapted to have a part thereof depressed toward the first surface and 
5 to direct light from the flexible element into the member at the depressed part. The 
depression of the part will narrow the light path at that point. Also, the depressed surface 
part of the flexible element may form a convex surface acting as a mirror reflecting light 
from the flexible element toward and through the first surface. This flexible element may 
be made of e.g. silicone, polyurethane, nylon, PVC, and/or transparent polyethylenes, and 
10 may have a thickness of 0.01 mm-1 Omm, such as 0.25mm-5mm, preferably 1 / 2 -1 mm. 

In that embodiment, the flexible element may have a first side comprising a number of 
predetermined first areas adapted to be depressed toward the first surface and a second 
side having, at areas opposite to the predetermined first areas, second areas which, in a 

15 first, non-depressed position, have a distance to the first surface and, in a second, 

depressed position, abut the first surface. This flexible element may be a keyboard, where 
the first areas define the keys. Preferably, each first area has a corresponding second 
area and vice versa. The difference in refractive index between the flexible element and, 
on the one hand, air, (the distance between the flexible element and the first surface) and, 

20 on the other hand, the first surface, ensures that (at least substantially) no light is 
transmitted to the first surface in the first position but is in the second position. 

From the knowledge of the positions of the second areas, the touch pad may be able to 
determine which first area was depressed and thereby which action to take. 

25 

It should be noted that the light having now passed the first surface, as described above, 
may be guided by the light transmissive means as well as the flexible member, depending 
on the border between these parts. If light may pass the border, light may travel into the 
flexible member and back into the light transmissive means. This has no impact on the 
30 position of the receiving means or the operation of the pad. 

The two positions of the second areas are an additional manner (other than merely e.g. 
an index difference between the flexible member and the light transmissive means or the 
use of collimated light not impinging on the interface) of preventing light from travelling 
35 from the flexible element to the first surface at non-intended positions. Preferably, the 
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flexible element also has, between the second areas, means for preventing unintended 
transmission of light from the flexible element to the first surface. 

A keyboard-like feature may also be provided when the touch pad comprises a 
5 depressing means having a first side comprising a number of predetermined first areas 
adapted to be depressed toward the first surface and a second side having, at areas 
opposite to the predetermined first areas, depression elements which, in a first, non- 
depressed position, do not to any substantial degree depress the flexible member and, in 
a second, depressed position, depress the flexible member. Preferably, the depressing 
10 means is a flat means having a first, upper side and a second, lower side, and where the 
opposite positions are positioned above and below each other. 

Different depressing means may be provided, thus providing an easy replacement of 
keyboards, the use of specialized keyboards (for games etc) and the use of the same 
15 basic module for pads for different countries. 

Means may also be provided in order for the touch pad to know which keyboard is used 
and how to interpret light transmitted from a given point at the first surface. 

20 An interesting depressing means comprises an at least substantially stiff member being 
rotatable in relation to a remaining part of the depressing means, the stiff member having, 
at its first side, a plurality of the first areas and, at its second side, a plurality of the 
depression elements. 

25 This stiff member may be a depressible pad or area, which may be rotatable in a plane at 
least substantially parallel to a plane of the first surface so as to provide a rotatable 
member (such as for scrolling in menus or controlling other means). In this manner, light- 
receiving portions may be obtained of the first surface, which portions move during 
rotation of the pad. Another manner is to have the member rotate around an axis at least 

30 substantially parallel to a plane of the first surface, in which manner, only one or a number 
of the depressing means at the second side thereof may engage the flexible member at 
the same time. A combination of the two rotations may be selected. 

A third manner of providing e.g. a keyboard is one comprising an element having a first 
35 side having a number of first predetermined positions for engagement of a user and a 
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second side having a number of second positions or areas corresponding to the first 
positions, the element being adapted to, when a first position is engaged by the user, emit 
light from the corresponding second position, the second side being positioned so that the 
light emitted may be received by the first surface. 

5 

In a preferred embodiment, the receiving means comprise means for detecting light 
received at at least two different areas or points, the detecting means being adapted to 
determine an angle of incidence of detected light at each area or point. In this manner, the 
position may be determined by simple triangulation. 

10 

Preferably, the detecting means comprise at least one detector and, for each area or 
point, a reflecting means or lens means for directing the light received at the area or point 
on to the at least one detector. 

15 In the preferred embodiment, the receiving means comprise means for detecting light 
emitted at a predetermined point of the first surface in two different directions and means 
for determining the position of the predetermined point from the directions in which the 
light was detected. 

20 Preferably, the detecting means comprise at least one detector and reflecting means or 
lens means for directing the light emitted in the two different directions on to the at least 
one detector. 

The touch pad may comprise at least two detectors each being an at least one- 
25 dimensional detector having a number of detecting points or areas, the detectors and 
reflecting/lens means being positioned so that light from two different points on the first 
surface are detected at different points/areas of at least one of the detectors. This 
facilitates determination of the actual point of entry of the light. 

30 Also, the pad may then further comprise a plurality of slots provided between the 

predetermined point at the first surface and the one-dimensional detectors, the detecting 
points/areas of the one-dimensional detectors being at least substantially equidistant. 
When, e.g. a distance between two adjacent slots being different from a multipla of a 
distance between two adjacent areas/points of a detector, these slots will be able to 

35 increase the resolution of the position/angle determination. 
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Several one-dimensional detectors may be used for the same detection in order to 
increase the resolution when either the slots/apertures are angled to a row and line 
direction of the detectors if their detecting points/areas are positioned in rows and lines. If 
5 the rows and lines are at straight angles to each other, slanted apertures may be used. 
Optionally, vertical apertures may be used when the lines and rows are not at straight 
angles to each other. 

Preferably, the at least one detector comprises a CCD detector, such as a CCD detector 
10 being a two-dimensional detector having a number of rows of detecting points/areas, and 
wherein each detector comprises at least one row of the CCD. 

Then, the pad could further comprise means for directing light from surroundings of the 
touch pad to one or more other rows of the CCD. This light could be an image from the 
1 5 outside of the pad, which image is then detected by the CCD. 

Also, a filter means or the reflecting/lens means could be adapted to transmit at least 
substantially only light within a predetermined wavelength interval. In this manner, noise 
from incident light, such as sunlight may be reduced or avoided. 

20 

Preferably, the touch pad is used together with a stylus or pen adapted to emit light from a 
point (that is, an end part) thereof, the stylus or pen being adapted to transmit light into 
the light transmissive means when touching and/or being translated over the first surface. 

25 An interesting embodiment further comprises means for receiving light from outside the 
pad and in a plane at least substantially parallel to the first surface and for transporting the 
light into the light transmissive means, the determining means being adapted to determine 
a position outside the pad from which the light is emitted. 



30 In that embodiment, the receiving means preferably comprise at least two lens means or 
mirror means positioned so as to direct light from the outside of the pad (such as light 
from the sun or external light emitters/lamps) along the plane into the light transmissive 
means. The lens or mirror means preferably form part of the light transmissive means. 
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This pad preferably further comprises means for directing light transported into the light 
transmissive means by the transporting means to the determining means. 

This embodiment may then actually derive position information also from the outside of 
5 the touch pad. The pad may be positioned at a working surface and then derive 
information from drawings etc. made on that working surface. 

In fact, 3D position information may be derived in that a lens/mirror means may be 
provided for also receiving light out of the plane. This received light is then also 
1 0 transported to the detector/receiving means. This additional information may be separated 
from the other information by providing it with a particular wavelength (the use of e.g. 
filters or a specific light emitter used to emit the light) or the light may be transmitted to its 
own detector, such as a separate row of a CCD. 

15 One particular use may be seen in relation to a particular stylus or pen having: 

a first light transmitting channel along a predetermined axis of the stylus or 
pen, 

means for providing light into and along the transmitting channel, 
20 - means for outputting the light from the transmitting channel, 

a receiving channel being adapted to receive light output from the transmitting 
channel and having been reflected outside the pen or stylus, and 
means for directing light from the receiving channel toward the receiving 
means of the pad. 

25 

This stylus/pen may be used for e.g. reading bar codes in that the bars may have differing 
reflective properties, which will result in a variation of the amount of light reflected and 
thereby directed toward the pad. 

30 The external work area may also be used as e.g. a newspaper or brochure, which is 

identified by the user (such as by a bar code or other information - such as the taking of a 
picture thereof). Subsequent to identification, the user may, using a stylus or other light 
provider, demarcate or identify e.g. products, which the user wishes to purchase or fill in 
forms etc. This information is then derived by the pad, which may transmit the information, 

35 such as by wireless Ethernet or a mobile telephone (if the pad is not part of the mobile 
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telephone as it is) to e.g. the provider of the products or the issuer of the 
brochure/newspaper. 

Another aspect of the invention relates to a pen/stylus for use in the above touch pad, the 
5 stylus having a light providing means and means for emitting light provided from a point of 
the stylus. The point of the stylus may be flexible. A flexible point may be made of e.g. 
silicone or polyurethane. In addition, the point may be made hydrophilic in order to reduce 
friction or the risk of scratching. Also, the light providing means may be a light emitter. 
Additionally, the light providing means could comprise means for receiving light from one 
10 or more surrounding light emitter(s), such as a solar cell or a lens - or a mirroring surface 
positioned at the point of the stylus. This mirroring surface may reflect light provided by 
the pad itself - such as light transmitted close to the first surface. 

A stylus with a flexible point may be used for providing different e.g. line thicknesses when 
15 e.g. drawing and for providing information relating to a force exerted during the 

drawing/writing. This last aspect is particularly interesting in electronic signatures in that, 
now, not only the positions (the signature itself as written) and the velocity at 
predetermined points may be used for identifying the signor, but also the pressure exerted 
at predetermined points. 

20 

Furthermore, the pen/stylus could have means for varying an intensity and/or wavelength 
of the light emitted, the variation being controlled by a controlling means controllable by a 
user. In this manner, the stylus may be used as e.g. a computer mouse now also having 
one or more buttons. Then, the controlling means preferably comprises an area of the 
25 stylus, the area being adapted to be exposed to pressure or depression by the user, 
exposure to pressure or depression will make the controlling means vary the intensity 
and/or wavelength. 

This variation may be used for a number of purposes: the pad may be adapted to only 
30 function with a given stylus or group of stylus, whereby the pad will not react to light 
entered not having a predetermined intensity variation/wavelength contents/polarisation. 
Also, different stylus may be decided to provide different colours on a monitor illustrating 
what is drawn on the pad. Alternatively or additionally, the variation may be taken as e.g. 
a mouse click, and the pad may respond correspondingly as is seen in normal PC's. 



SUBSTITUTE SHEET (RULE 26) 



WO 03/077192 



10 



PCT/DK03/00155 



The invention also relates to a stylus or pen having: 

a first light transmitting channel along a predetermined axis of the stylus or 
pen, 

5 - means for providing light into and along the transmitting channel, 
means for outputting the light from the transmitting channel, 
a receiving channel being adapted to receive light output from the transmitting 
channel and having been reflected outside the pen or stylus, and 
means for outputting the light from the receiving channel. 

10 

A further aspect of the invention relates to a method of operating a touch pad, the method 
comprising: 

providing a light transmissive means having a first surface adapted to receive 
15 light, 

receiving light at the first surface, 

transmitting the received light inside the light transmissive means along the 
first surface, 

receiving the transmitted light by a first and a second means, 
20 - outputting, from the first and second means, corresponding signals, and 

determining, on the basis of signals from the receiving means, a position of the 
first surface having received light. 

As indicated above, the method could comprise a display or monitor (making it a touch 
25 screen) providing or displaying information through the first surface of the light 
transmissive means. 

Also, the providing step may comprise providing a light transmissive means comprising an 
at least substantially flat light transmissive member having at a surface thereof a light 
30 transmissive coating or layer, an upper surface of which forms the first surface of the light 
transmissive means. Then, the providing step could comprise providing a member 
comprising a light transmissive display or monitor - again providing a touch screen. 

In one embodiment, the touch pad further comprises a flexible element positioned at or on 
35 the first surface and a light emitter, the light emitter transmitting (preferably collimated) 
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light into the flexible element, the method comprising the step of depressing a part of the 
element toward the first surface and directing light from the flexible element into the 
member at the depressed part. 

5 This depression may provide an upper surface of the flexible element reflecting the light 
through the first surface. 

The flexible element may have a first side comprising a number of predetermined first 
areas adapted to be depressed toward the first surface and a second side having, at 

10 areas opposite to the predetermined first areas, second areas, the method comprising 
depressing one or more of the first areas and bringing the one or more corresponding 
second areas from a first, non-depressed position in which the corresponding second 
area(s) have a distance to the first surface into a second, depressed position, where the 
corresponding second area(s) abut the first surface. Then, the method may further 

1 5 comprise the step of preventing transmission of light from the flexible element to the first 
surface between the second areas. 

Alternatively or in addition, the touch pad could comprise a depressing means having a 
first side comprising a number of predetermined first areas adapted to be depressed 

20 toward the first surface and a second side having, at areas opposite to the predetermined 
first areas, depression elements, the method comprising depressing one or more of the 
first areas of the depressing means so as to bring one or more of the corresponding 
depression elements from a first, non-depressed position in which they do not to any 
substantial degree depress the flexible member, to a second, depressed position in which 

25 they depress the flexible member. 

In this embodiment, the depressing means could comprise an at least substantially stiff 
member having, at its first side, a plurality of the first areas and, at its second side, a 
plurality of the depression elements, the method comprising rotating the stiff member in 
30 relation to a remaining part of the depressing means so as to bring one or more second 
areas from the first to the second positions. As indicated above, the axis of rotation may 
be in a plane of the first surface or at an angle thereto depending on the actual use of the 
stiff member. 
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In another embodiment, the touch pad further has an element having a first side having a 
number of first predetermined positions for engagement of a user and a second side 
having a number of second positions or areas corresponding to the first positions, the 
method comprising the step of, when a first position is engaged by the user, emitting light 
5 from the corresponding second position and receiving the emitted light by the first surface. 

In one embodiment, the receiving step comprises detecting light received at at least two 
different areas or points, the determining step comprising determining an angle of 
incidence of detected light at each area or point. Thus, triangulation may simply be used 
1 0 for the determination. 

Then, the touch pad preferably comprises at least one detector, the method comprising 
the step of directing, using a reflecting means or lens means, the light received at the area 
or point on to the at least one detector. 

15 

Also, the detecting and determining steps could comprise detecting light emitted at a 
predetermined point of the first surface in two different directions and determining the 
position of the predetermined point from the directions in which the light was detected. 
Then, preferably, the touch pad comprises at least one detector, the method comprising 
20 directing, using reflecting means or lens means, the light emitted in the two different 
directions on to the at least one detector. 

Preferably, the touch pad comprises at least two detectors, each detector being an at 
least one-dimensional detector having a number of detecting points or areas, the method 

25 comprising the step of detecting light emitted from two different points on the first surface 
at different points/areas of at least one of the detectors. Then, the resolution could be 
increased by e.g. the step of providing a plurality of slots or apertures between the 
predetermined point at the first surface and the one-dimensional detectors, the detecting 
points/areas of the one-dimensional detectors being at least substantially equidistant, and 

30 a distance between two adjacent slots being different from a multipla of a distance 
between two adjacent areas/points of a detector. 

In the preferred embodiment, the touch pad comprises a two-dimensional CCD detector 
having a number of rows of detecting points/areas, wherein the detecting step comprises 
35 detecting light transmitted by the transmissive means by one or more of the rows of 
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detecting points/elements. Then, the method could further comprise the step of directing 
light from surroundings of the touch pad to one or more other rows of the CCD. Also, the 
method could further comprise the step of transmitting at least substantially only light 
within a predetermined wavelength interval in order to e.g. reduce noise from incident light 
(sun light or the like). 

As indicated above, the step of providing the light preferably comprises providing a stylus 
or pen emitting light from a point thereof and transmits light into the light transmissive 
means when touching and/or being translated over the first surface. 

An interesting embodiment is one, which further comprises the steps of: 

receiving light from outside the pad and in a plane at least substantially parallel 
to the first surface and 

transporting the light into the light transmissive means, 
the determining step comprising determining a position outside the pad from which the 
light is emitted. 

This embodiment may further comprise providing at least two lens means or mirror means 
positioned so as to direct light from the outside of the pad along the plane into the light 
transmissive means. Also, the steps of providing the light transmissive means and the 
lens or mirror means could comprise providing the light transmissive means and the 
lens/mirror means as a single/monolithic element. In addition, the method could comprise 
the step of directing light transported into the light transmissive means by the transporting 
means to the determining means. 

The method could also comprise the step of translating a stylus or pen having: 

a first light transmitting channel along a predetermined axis of the stylus or 
pen, 

means for providing light into and along the transmitting channel, 

means for outputting the light from the transmitting channel, 

a receiving channel being adapted to receive light output from the transmitting 

channel and having been reflected outside the pen or stylus, and 

means for directing light from the receiving channel toward the receiving 

means of the pad 
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over a surface having areas of varying light reflection, the light or stylus directing light of 
varying intensity toward the touch pad, 

wherein the determining step comprises determining information from the variation in the 
light intensity. 

Furthermore, the method could comprise providing light at the first surface using a stylus 
or pen, the method further comprising the step of varying an intensity and/or wavelength 
of the light emitted, the variation being controlled by a controlling means controllable by a 
user, and wherein the determining step comprises detecting the variation (and perhaps 
acting accordingly). Then, the varying step preferably comprises the user depressing an 
area of the stylus, the depression facilitating the variation of the intensity and/or 
wavelength. 

In the following, a preferred embodiment of the invention will be described in relation to 
the drawing, wherein: 

Figs. 1-3 illustrate different selections of flexible stylus point and flexible layer, 
Fig. 4 illustrates an overlay keyboard, 

Fig. 5 illustrates a rotating disc or joystick for use with the keyboard of Fig. 4, 

Fig. 6 illustrates a new type of icon and navigation in the system, 

Figs. 7 and 8 illustrate different types of overlay keyboards, 

Fig. 9 illustrates the use of apertures/slots, 

Fig. 10 illustrates the function of apertures/slots, 

Figs. 1 1 and 12 illustrate a preferred set-up of the present invention, 

Fig. 13 illustrates a particular type of useful CCD for use in accordance with 

the invention, 

Fig. 14 illustrates a preferred embodiment adapted for 3D position 
determination external to the pad, 

Fig. 15 illustrates a bar code reader for use external to the pad, and 

Fig. 16 illustrates the use of the preferred invention for deriving information 

provided on a white board external to the pad. 
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Preferred embodiment of O-pen touch screen 

The preferred embodiment concerns a method to produce a passive and/or active and/or 
responsive and/or internal and/or external optical touch screen with a flip over Keyboard 
including joystick and scroll functionality by employing various means which can be "tailor 
5 made" or found as integral parts of many electronic devices such as digital CCD, light 
source, software, ROM, processor, power supply, print, a screen and a transparent 
screen cover (25) including special layers and mirrors and aperture and filters + various 
means for writing with a lighted or a reflective pointed tool both possible to combine with 
ordinary writing tools and means for presenting reflections from barcodes. 

10 

All the below-described functionality is preferably controlled by a single controller, 64, of 
the pad. 

CCD for digital detection of position 

15 A CCD is used as light detector because it is cheap, energy economic + 100% digital and 
thus possible to build into coming single chip mobile phones. The digital image sensor is 
expected to follow Moore's law and double performance concerning key parameters such 
as resolution, energy consumption, position update frequency sensitivity etc. every 18 
month. This means that competing touch screen technologies with analogue components 

20 cannot keep pace with the quality development. 

CCD synchronising with incoming light signal and ambient light 

In order to pick up the strongest possible signal with the best signal/noise ratio the 
software tunes the CCD to the exact same frequency as the signal emitting light source. 
25 Both the pen and the CCD tune in to the same frequency that is out of synchronicity with 
the local electric grid net. 

CCD matching screen luminance to ambient light 

The CCD measures the ambient light and set the screen luminance to an adequate level. 
30 This feature saves energy by optimising the power for screen luminance to a minimum. 
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Screen cover (25) with optics for internal and external touch screen 

O-pen technology is based on digital imaging of light that enters into a transparent layer 
above or under a screen. If the angles of light are bigger than the Brewster angle then 
most of the light will pass right through and if the angles of light are smaller then most of 
5 the light will bounce right of the surface. Only close optical contact between the screen 
cover (25) - see Figs. 1-3 - and a light emitting source such as a pen point (1) enables 
light to pass into the screen cover (25) and because of the Brewster angle the light moves 
in straight lines inside the screen cover (25) until it is absorbed. The touch screen 
functionality can be established anywhere beneath or above the transparent screen cover 
10 (25), even 360 degrees around an irregular object. 

A display or monitor 65 is illustrated in Fig. 1, which makes the touch pad function also as 
a touch screen. 

15 O-pen technology can be incorporated into for instance a mobile terminal with slight 
alterations of the screen cover (25) and simple modifications of software and/or the 
electronic components. 

The screen cover (25) consists of a stiff transparent layer of for instance PET and a soft, 
20 scratch resistive upper layer of for instance silicone. Such a screen cover (25) has 
excellent transparency compared with screen cover (25)s with resistive touch screen 
functionality. The inherit properties such as high brilliance, high luminance, good side 
visibility and low distortion leads to considerably lower power consumption, less battery 
capacity need and less voluminous design requirements. 

25 

One primary concave mirror (10) - see Fig. 1 1 - is placed in each side of the screen to 
project incoming light from a wide angle of the screen to a left and a right secondary 
concave mirror (13) that project the light against desired areas of for instance a CCD. The 
primary concave mirrors in each side are also concave mirrors in the vertical plane in 
30 order to reflect the incoming light towards the secondary concave mirrors (1 3) in 
minimized angles. The primary concave mirrors (10) focus the light and act as a light 
signal amplifier as well as 2D to a 1D reduction system, which only need a small 
elongated area out of for instance one CCD. 
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Mirrors are coated with a selectively IR mirroring layer and lenses (27, 28, 29) to see out 
of the internal screen is coloured so only the desired IR wavelengths pass through. 

The screen cover (25) underside is coated with a selective IR mirroring layer in order to 
5 avoid any undesired optical effects due to optical contact between screen cover (25) and 
screen. 

Under the two secondary concave mirrors (13) that project the light to the CCD the screen 
cover (25) is not coated with an IR mirroring layer. 

10 

The screen cover (25) can be produced in a single mould with a double moulding process 
where the first hard plastic with all the optics is produced in the first process and the softer 
upper layer is produced in the last process. The screen cover (25) edges have angles that 
let light pass out and is coated with an absorbing layer except where there is placed 
15 mirrors (30,31,32) - see Fig. 14 - and lenses (27,28,29), which transmit light in the optic 
system. 

Apertures for triangulation and aperture for camera functionality 

A thin film (19) - see Figs. 9-10 - with at least one row of apertures in a recognizable 
20 "barcode" like pattern (20) for both left and right canal and one aperture for the camera 
functionality is placed beneath the secondary concave mirrors. Each aperture creates a 
picture of the light that enters from the screen cover (25). Since we are looking at dots 
(23) there are no problems with multiple exposures and each aperture add a viewing 
angle and thus increase the achievable resolution. 

25 

The apertures are slightly tilted so the light passing through them will be received by 
different rows of the CCD slightly dislocated. This dislocation creates a better signal for 
triangulation. Each row is analysed separately because the pattern is slightly different 
from the pattern of the row beneath and the row above. During the analysis the software 
30 will find the extension of the light intensity distribution on the CCD by finding the first dark 
pixel on each side and also by finding the pixel with peak intensity. Then the software will 
compare all the rows to find the row with the highest peak intensity and to find the exact 
extension of the light intensity distribution by finding the darkest pixels close to the light 
intensity distribution. This enables the software to create a precise image of the light 
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intensity distribution including peak and extension. This is done for every light extension 
distribution behind every aperture in every row exposed to incoming light from the 
transmissive layer (25, 26). A large/medium/small extension of the light intensity 
distribution correspond to a large/medium/small contact area and or the indent made by a 
5 stylus with an internal light emitter or a stylus with no internal light emitter depressing of 
the soft upper layer (26). A highest peak correspond to the centre of a contact area. 

Under the thin film (19) with apertures three separate transparent spacing pieces 
(45,46,47) for right and left canal plus camera are placed. The CCD is glued to the 
10 spacing pieces (45,46,47) - see Fig. 1 1 - with for instance silicone for optimum stability, 
vibration protection and optical contact with minimum light information losses. 

A camera lens (22) in for instance silicone with an IR reflective coating underneath is 
glued on top of the screen cover (25) above the camera aperture and the CCD (21) to 
1 5 allow the CCD to both detect light for a digital triangulation of position and to detect light to 
create digital pictures. 

Passive internal touch screen 

In the edge of the screen cover (25) - see Figs. 1-3 - opposite the CCD, light moving in 
20 near straight angle is send into the upper soft screen cover (26) layer via a lens. A slight 
difference in the refractive index creates a small Brewster angle between the two layers. 
Any depression of the upper soft layer by any object such as a finger, a pen etc. will 
create an indent that mirror light beams down wards and all light beams that do not 
exceed the Brewster angle between the screen cover (25, 26) and air will stay trapped in 
25 the screen cover (25, 26) and thus be transmitted to the CCD enabling the software to do 
triangulation. The light has an alternative colour corresponding with selective filters that 
allow this colour exclusively to pass apertures for this particular function. 

Passive external 2D touch screen 

30 

Two wide-angle lenses (27,28) - see Fig. 14 - are placed in the edge of the internal 
screen cover (25) and two concave mirrors (30,31) are placed in the opposite side to 
project incoming light from the wide-angle lenses. The concave mirror (31) furthest from 
the CCD project the light from the furthest lens (28) via a special primary concave mirror 
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(60), below or above the ordinary primary concave mirror (10) and then to the secondary 
(13) and through the thin film with aperture (19) to the CCD. The special primary concave 
mirror (60) is coated to reflect only light in wavelengths coming from external signal 
providers and the rows of the CCD, which detect the light from external signal providers 

6 are have filters, that only accept light with wavelength similar to the external signal 
providers. The concave mirror closest (30) to the CCD project the light from the nearest 
wide-angle lens (27) directly to the closest secondary concave mirror (10) and through the 
thin film with apertures (19) to the CCD. The optics for the canals is adjusted to cover a 
desired external angle of for instance 90 degrees establishing an external touch screen, 
10 that can be employed close range for hand writing (52) or at a white board size touch 

* screen (51) - see Fig. 16. 

Active external 2D touch screen 

An external touch screen becomes active if an active screen is front or back projected to 
15 for instance a white board or a table - see Fig. 16. In order to use an active external 2D 
touch screen with accuracy a calibration procedure must be employed to establish the 
correct position of the projected screen relative to the position of the device with built in 
external touch screen facility. Letting the screen project points and then have the user 
touch the points with an active pen (1) allows the software to triangulate the pen touching 
20 the points and to calculate the relative position. Built in mobile telecommunication or close 
range transmission technologies allow users to share images and information drawn and 
projected on active external 2D touch screen. The sharing process can involve any wire 
less LAN technology such as Bluetooth, IRDA, Intranet, Internet and so on. 

25 External 3D touch screen 

3D information can be added to the triangulation process by placing a third wide-angle 
lens at a place where the screen cover (25) is bending 90 degrees - see Fig. 14. The 
incoming light from the 3D wide-angle lens (32) is transmitted to the CCD in the same way 
as the furthest 2D wide-angle lens (31). 

30 

Custom defined, chosen or designed icons 

For both passive and active external touch screens users can place either visible or 
invisible icons in positions that when touched can command the execution of desired 
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functions just like a traditional digitiser or mouse. Fixed icons can be placed at a table to 
ease commands for a desktop or a lap top computer. Fixed icons could be for instance a 
standard qwerty keyboard or any other preferred customised keyboard. Any digitiser icons 
can be printed and associated with the proper commands by establishing their position in 
5 relation to the device with an external touch screen. 

An icon can for instance be a portrait that appears when a contact in the phone book is 
high lighted. This "contact" icon (36) - see Fig. 6 - is a circle where usual contact related 
information is placed clockwise and command likewise so a simple dot with the pen can 
10 call, SMS, MMS, mail, fax etc. a person. Icons can have outer rings with more command 
structures. 

Keyboard, scroll and joystick 

A Keyboard (35) - see Figs. 4-8 - can be moulded in a soft, tough, responsive and 

15 transparent material such as silicone or polyurethane. The Keyboard is mounted with 
suction pads upon the touch screen. IR light is send into the keyboard directly through the 
screen cover (25) into one of the suction pads (43). The keyboard is moulded with light 
diffusing particles. A partial covering IR mirror layer (41) disconnect the keyboard optically 
from the screen cover (25). Each button is slightly above the screen cover (25) and has a 

20 point (40) that can be connected optically to the screen cover (25) by pressing it down. 
The incoming light will be detected and triangulated. Placing contact points (40) around 
for instance a rounded shape makes joystick and scroll functions. When the user press or 
pull a contact point (40) comes into contact and send a signal. The buttons optical contact 
point is made in a 3D design that ensures that increased pressure will enlarge the contact 

25 area or shape it in a particular form. This is detected and analysed as a responsive signal 
that can be associated with distinctive commands depending of the shape. The design 
allows for customisation of users products by choosing flip over Keyboard and screen 
created graphics beneath the buttons as accessories. The Keyboard design allows for 
tactile features that can help persons with poor eyesight as well as anybody else to use 

30 their electronic products better. Icons according to the producers or the individual user 
wishes can be mounted beneath the Keyboard in areas where there is no active screen 
beneath the touch screen. 
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A touchy feely flip over Keyboard combined with software and audio and/or visual feed 
back can create an interface with a suitable dialog structure for diverse machines and 
products where it is important not to depend on direct visual control. Such a touchy feely 
interface could control for instance peripheral functions in a car such as temperature, 
5 humidity, radio, cd or MP3-player, mirror positions, light etc. 

Pen for active input to internal touch screen 

The pen (1) for active input to internal touch screen is made with an internal light source 
and the pen point is chemically coated to bind one molecule thick layer of water in order to 
10 increase the optical contact and to ensure pleasant super low friction use. The pen point 
is completely rounded to ensure the same contact area no matter which angle the users 
choose to tilt his or hers pen. A pen touching the soft upper layer (26) of the internal touch 
screen will create a small indent (15) that acts like a wide-angle lens and increase the 
entrapment of incoming light in the screen cover (25, 26). 

15 

This pen has a light emitter 63, the wavelength and/or intensity of which is controlled by a 
controller 61 activated by a button 62. 

Pen for input to external touch screens 

20 An ordinary pen or a white board marker has a built in pressure sensitive contact that 
activates a built in IR light source when the pen or marker is pressed against a writing 
surface so light is emitted to be detected by the wide-angle lenses (27,28) and 
triangulated by the software. 

25 Naturally, this pen may also have the ability to vary its intensity/wavelength as is 
described above. 



Pen for barcode reading 

30 A pen point to scan barcodes (5) - see Fig. 15 - consist of a co-axial pipe divided in a 
central light emitting pipe (8), that via a light conduction is connected to an IR light source, 
a light shielding pipe (7), a light conducting pipe with light diffusing properties (9) and a 
light shielding pipe (7) with a stripped light ring (18) that permit the light diffusing pipe to 
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be seen by the wide-angle lenses (27,28). The barcode reader rest on its outer pipe while 
the user scans the pen upright over a barcode. The light coloured intersections of the 
barcode reflect light beams into the diffusing pipe and the ring of light is detected via the 
wide-angle lenses. The shadow/light signal is correlated with the triangulated position 
5 enabling the software to read the barcode properly because both speed and dark light 
reflections can be analysed. The user points out the corners of the barcode before 
scanning them in order to enhance the bar code reading accuracy. This enables the 
software to determine the direction and speed of the bar code reader pen relative to the 
barcode. 

10 

Ordering goods and information with O-pen technology 

Each spot of an object with unique bar code identification is assigned to contain 
information. Upon reading a unique bar code identification within an external touch screen 
the user will be prompted to answer whether or not to access a homepage corresponding 

15 to the bar code. Upon user acceptance to access the homepage the bar code assigned 
information is retrieved to the device and the following procedures are carried out. (can be 
done online as well.) The user marks the corners of the object with unique bar code 
identification by pointing a pen within an external touch screen. Now the device contains 
information assigned to any particular position and the relative position of any particular 

20 position. The user can now point out any position to access information or commands 
assigned to this particular position. As an example, a picture of a woman in a car driving 
past a hotel can contain information about the car, the woman dress, the hotel and how to 
purchase either of them. Any object such as goods, papers and magazines etc. can 
contain unlimited information that can be retrieved from the Internet in this way. User 

25 manuals, origins, advanced details concerning logistics, cooling chain information, health 
warnings, legal notice, test schemes, list of content, price, warranty etc. can be part of the 
information. The user can beforehand access their own personal homepage and enter 
any settings they want retrieved information to be matched to. The settings could for 
instance involve personal preferences of purchase including for instance body 

30 measurements, allergic risk assessment, diets, financial status, shopping lists, gift list, 
information needs in respect to different interest and so on. All information on goods and 
information of choice can be stored in a virtual shopping cart and retrieved when it is 
convenient for the user to make decisions of purchase. A part of the personal settings can 
involve software agent that automatically search the Internet for cheaper similar product 
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offers. The user can in this way systemise purchase and information gathering in order to 
gain savings and increased quality. 

Unique identification of active signal providers 

5 All active signal providers have unique identification in the form of a repeated particular 
amplitude pattern (37), which can be recognised by the software. This can be useful when 
a number of people are working together on the same screen or there is a need for 
differentiating between colours or other signal provider specific elements. A device only 
grants access to users according to the principal user's settings of user access depending 
10 on specific active signal providers with unique identification. 

Calibration of active signal providers 

A factory calibration is done once and for all by applying gradually harder pressure to a 
point in contact with all points of an O-pen touch screen. The pressure will increase the 
15 size of the area in optical contact with the touch screen and/or alter the contact areas 
shape. The software will then store information about the shape depending on applied 
pressure and become able to identify the pressure. This enables the software to represent 
all active signal providers in a responsive manner. The software can furthermore have 
built in simulations of particular writing tools such as various brushes pens etc. 

20 

Responsive accuracy can ensure higher quality digital signature 
High quality measurement of handwriting including the particular pen point speed 
variations and the pressure variations plus the unique amplitude pattern (37) identification 
of signal providers enhance the credibility of a digital signature performed by the user 

25 every time an action needs a signed confirmation. The digital signature security is greatly 
increased because the device with O-pen touch screen, the signal provider, the address, 
the person and the signature plus possible a picture taken by the built in camera all can 
be confirmed. Devices with O-pen technology will be able to function as extra secure 
credit cards both in normal purchase situations and when the user purchase goods and 

30 information over the net. 

The overall operation of this feature is a combination of the above-mentioned broadening 
of the stylus tip with increased pressure thereon while signing. Thus, a correlation of not 
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only the positions (the actual signature) but also the velocity at given positions and the 
pressure exerted at positions may be used for further ensuring the identity of the signor. 

Calibration of touch screens 

5 A simple figure with a well-known form is placed on the touch screen and the adequate 
pen is used to outline the figure. If the software triangulates an outline image, which 
correlate with the figure then the touch screen is accurate. If not then the software can 
reset the angles and in this way compensate for in precise optics. Given that the 
production accuracy is high enough the calibration can be done once and for all in the 
10 production process. 

Alternative to soft keyboard, scroll and joystick 

Instead of a soft all in one piece keyboard a keyboard can be moulded of hard plastic 
15 parts with small contact areas suited to create small indents in an upper soft layer (26) 
that will cause light beams to be reflected up and down to the CCD through the lower hard 
part and the upper soft part of a transmissive layer (25, 26). The keyboard has a rigid 
supportive structure that spreads out pressure over a larger area of the upper part of the 
transmissive layer (26) in order to prevent incidental indents and consequently noise 
20 creation in the form of up and down reflecting light beams to occur. The individual keys 
are supported by the supportive structure and only the individual keys contact area can be 
pressed through holes in the supportive structure into the upper soft layer (26) of the 
transmissive layer. Scroll and joystick keys are fitted to the supportive structure with 
elastic glue such as silicone. When the user press the outer perimeter of a scroll button 
25 one or more contact areas create detectable indents in the upper soft part (26) of the 
transmissive layer. The contact areas can be formed so an increased pressure will 
enlarge the indent enabling the touch pad and software to detect a responsive signal. 
Adding a central stick to a scroll button that can be pulled instead of pressed makes a 
joystick. 

30 

Alternative identification of active signal providers 

A number of different pens can be employed simultaneous if a colour CCD is used or if 
the optical system separate colours with colour mirrors or filters. The emitted light from 
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each pen will then have a unique colour that can be separated form the others by the 
software. 

Alternative holographic optics 

5 The entire optic system can be produced in a holographic production process. This will 
decrease production variations and thus increase accuracy. In very complex variations it 
will also become an economic advantage. 



10 Alternative pen point design 

Alternative to a hard pen with a rounded point a soft pen point can be employed to 
increase the contact area. This is beneficial especially in connection with hard surfaces. A 
pen with a feather load relief of excessive pressure can reduce stress on the surface and 
pen point. 

15 

Alternative to active signal providers 

Internal light emitters can be fitted in the device instead of in the active signal providers. 
Combined with pens that are coated with a reflective layer, this will enable use of inactive 
pens with no internal light emitter. The emitted light is preferably concentrated close to the 
20 surface and the pens are only reflective in an area at or very close to the pen point. The 
reflective pens (3) can be produced at virtually no cost at all or even be just a pen point 
cover. Alternatively an ambient collecting pen (4) made of a transparent material can 
collect light and send it into the screen cover (25). 

25 Alternatively the pen can emit light in the form of heat that is charged to the pen through 
for instance microwave or friction or induction or a built in radioactive heating. 

Alternative mounts of Keyboard 

The Flip over Keyboard (35) can be mounted by push buttons or slide into holders or be 
30 produced as a strap on solution or glued'on or welded on or screwed on. 
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Alternative to concave primary mirrors 

Convex primary mirrors (11) can reflect light but not with amplification. 

The aperture or the apertures (19) can be placed in front of a primary mirror (10). 

5 

The aperture or the apertures (19) and mirrors (10,13) can be combined with lenses. 

One wide-angle lens can be placed in front of one or more apertures. Through this lens 
light directly from the pen point and light reflected from internal screen edges with colour 
10 selective mirrors that divide the light from the pen into two separate colours is projected to 
the image sensor. This will project at least three clearly defined dots on the image sensor 
enabling the software to do an accurate triangulation. 

Employment of more lenses on top of each other with a slight disposition can enhance the 
15 resolution. So can employment of more lenses with one or more aperture that only covers 
a smaller angle of the entire screen. 

Alternative to concave secondary mirrors 

Instead of secondary mirrors an optical taper (57) placed after the apertures (19) can 
20 concentrate the light on a small part of the image sensor. 

Partial amplification of touch screen resolution 

A primary concave mirror (10) with a flatter or more curved form in particular parts can 
create an angle-differentiated resolution that can compensate for lowered resolution in for 
25 instance distant corners etc. 

Alternative to multiple apertures 

Partial monochrome image sensor can enhance the resolution because there are four 
times as many pixels as compared with colour image sensors. 

30 

Instead of multiple apertures or in combination with multiple apertures the image sensor 
can have rows of pixels that are slightly dislocated (39). The dislocation could be for 
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instance 1/10 of a pixel width. This will create a slight differentiation between each row 
and thus increase resolution. 

Multiple apertures can be colour separated and match a particular colour filter in front of a 
5 row of the image sensor. This can be combined with colour selective reflective sides of an 
internal touch screen produce an increased resolution. 

Alternative to bar code reader 

The built in camera or a connected camera or a wireless camera can be used photograph 
10 an unique code consisting of a micro pattern, which can be invisible to the human eye. 
The invisibility can be achieved by printing the pattern with ink that is only visible outside 
the visible light wavelength spectre for humans or by incorporating the pattern into raster. 
Invisibility enhance the visual design opportunities and the code can still be detectable 
either by scanning for it with the camera or by establishing a standard right upper corner 
1 5 position for instance. 

Image sensor with no 2D to 1 D reduction 

A lens cap can ensure that the image sensor only receive light input from the pen point. 
An IR light filter ensures that light from the touch screen won't interfere with the camera 
20 image when the touch screen is not used. A more advanced lens cap can be made by 
involving a camera shutter that can close the light from the photographic lens allowing the 
image sensor to take pictures alternatively in between updating position. 
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